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ABSTRACT 

This study explored the portfolio evaluat ion process 
from the perspectives of teachers using portfolios to evaluate their 
students and teachers using portfolios of their own to evaluate their 
teaching* Two university professors, one elementary school teacher, 
and one secondary school teacher participated, using qualitative 
research methods. Qualitative research indicated that portfolios 
provided ways for teachers to reflect on diverse and sometimes 
conflicting purposes for evaluation. Learners gained self-awareness; 
and both learners and teachers were able to focus on change in ways 
that supported learning. Teacher portfolios offered ways for them to 
model the learning process for students. Findings support the belief 
that portfolio use can be implemented as a process by which students 
and teachers construct complex portraits of themselves. Attachments 
include **Portfolio Process and Teacher Change: Elementary, Middle, 
and Secondary Teachers Reflect on Their Initial Ex^^eriences with 
Portfolio Evaluation" by Ronald D. Kieffer and Mark A. Faust (in 
"Multidimensional Aspects of Literacy Pesearch, Theory, and Practice" 
edited by Chirles K. Kinzer and others, published by the National 
Reading Conference, Inc., 1994) and "Taking It Personally" (from 
"Portfolio News," v6 n3 Spring 1995) by Mark A. Faust, Ronald D. 
Kieffer, and Jane Hansen. (SLD) 
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Focus of the research 

This study explored portfolio evaluation as a process from two 
perspectives: 1) teachers using portfolios to evaluate their students and 2) 
teachers using portfolios of their own to evaluate their teaching. The initial 
research questions included the following: How does portfolio process support 
authentic evaluation of language teaching and learning in elementary, 
-secondary, and university classrooms? How are some teachers and students 
using portfolios in their classrooms? Have these practices altered the 
teaching/learning environment in the classroom? What is the role of 
reflection in the portfolio process? These exploratory questions initially 
guided the design of the study. 

Since the researchers (two university professors, one elementary 
school teacher, and one secondary school teacher) were using qualitative 
research methods, additional questions were added as the study evolved: What 

are individual students actually learning in particular classrooms? How and 
why are these students learning? What evidence exists to support the claim 
that students are indeed learning what they need to be learning at a particular 
time? How might students themselves respond to questions about what they 
are learning and why? Who decides what students need to learn and on what 
basis are such decisions made? Can students assume some responsibility for 
their own learning? Is it possible to define standards without standardizing 
\learni ng? 

This study was influenced by the notion that portfolio evaluation can be 
profitably investigated as a process that students and teachers undertake 
together. Unlike much current research that focuses on portfolios as end 
products that are used solely for the purpose of judging student progress and 
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performance, this study sought to explore the potential benefits of using a 
portfolio process to foster self-reflection and self-evaluation on the part of 
teachers and students. The researchers acknowledged that such a process can 
be used to support various types of summative evaluation but they wanted to 
investigate what happens when this goal is seen by teachers and students as 
secondary to other evaluation purposes. The researchers hoped to document 
ways that teachers might use portfolios selectively for multiple purposes 
aimed at enhancing their ability to create conditions that support a range of 
literate behaviors in their classrooms. 

Changes in plans 

Early on the researchers began to distinguish between assessment 
(ways of gathering of data about learning) and evaluation (ways of defining 
the value of learning). They also questioned their implication that there might 
be one way of defining "the portfolio process" and began to favor instead a 
more open-ended view of "portfolio use as a process." In addition, it has 
become clearer to the researchers that defining portfolio use as a process is 
connected with ideas about teaching as learning and teaching as a form of 
research. Consequently, they would wish to amend the original title of this 
project to read: "Portfolio use as process: Teacher-researchers exploring 
assessment and evaluation alternatives." 

Otherwise, the study proceeded as described in the original proposal. No 
substantive changes were made. Permission was requested and granted to 
extend the length of time allotted for the completion of Phases V and VI. A 
portion (approx. $400) of the funds designated for teacher release time were 
not spent because on a number of occasions the timing of interactive sessions 
did not necessitate the hiring of substitutes. A portion (approx $600) of the 
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funds designated for travel were not spent because the two teachers were 
unable to travel with the two principal investigators to attend the 1995 AERA 
convention in San Francisco. 

Findings 

This study resulted in numerous findings of great significance to 
anyone interested in using portfolios for purposes other than external 
evaluation. Some of these are summarized below; all are associated with a view 
of portfolio use as a process involving teachers and students in "researching” 
their classrooms as learning environments. 

1. When viewed as a process, portfolios begin with questions about 

purpose and audience, questions about what children are learning and why 
which lead students and teachers to reflect on what is happening in their 
classroom. 

2. The portfolio process continues with new questions about expectations 

(What exactly will teachers and students be doing during the process of 
portfolio creation?), collection (On what basis will the range of items that 
might be included in a portfolio be determined?), selection (On what basis will 
specific items be selected-or created-for inclusion in a portfolio?). 

Organization (What will the portfolio as a container look like?), and reflection 
(What will be the role of reflection throughout the process of creating a 
portfolio?). 

3. There are multiple purposes for evaluation (e.g. judging, responding, 

and accounting—See attachment A: Kieffer, R. & Faust, M., 1994). 
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4. Multiple purposes for evaluation are revealed through metaphors used 
in discussion about learning and evaluation (e.g. proof, tool, growth, progress, 
vehicle, catalyst, portrait, story.) 

5. Portfolios provide ways for teachers to reflect on diverse and sometimes 

conflicting purposes for evaluation which in turn can help them transform 
their classrooms into more coherent and supportive learning environments. 

6. During various stages of reflection, learners gain seif- awareness of 
their own literacies and the literacies of others, self-evaluate learning, name 
purposes and set related goals, and document important self-realization and 
change. 

7. The process of creating a portfolio encourages students to take 
responsibility for their own learning and to practice self-evaluation. 

8. Portfolios enable teachers and students to focus on change in ways tha>; 

support learning. Attending to change via portfolio process can be; non- 
judgmental, non-linear, retrospective, and individualized. 

9. Teacher portfolios offer ways to model the learning process so students 
can learn how to see themselves as learners engaged in a similar process. 

10. Portfolios can be used to foster teachers' self-knowledge about past and 
current teacher and learner practices (See attachment B: Faust, M., Kieffer, R. 
& Hansen, J., 1995) 

11. Multiple voices (students, teachers, peers, parents) support teachers’ 
ways of knowing about their instructional practices. 

Research implications 

This study lends credence to the notion that portfolio use can be 

implemented as a process whereby teachers and students construct complex 

portraits of themselves which make their learning visible in ways that are 
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overlooked or even suppressed by traditional evaluation procedures such as 
testing and graded writing. Furthermore, this study clearly suggests that a 
significant degree of student ownership of the process can foster an enhanced 
sense of purpose associated with classroom learning. From the teacher's 
perspective, approaching portfolio use as a process can also help to 
distinguish among competing evaluation purposes. Being clear about 
multiple evaluation purpose enables teachers to uphold clear standards while 
at the same time fostering a climate in which it is possible to acknowledge 
individual needs and learning goals. 

Several factors distinguish this study from previous research on 
portfolio evaluation. First, the researchers created portfolios of their own 
along with their students. Second, the researchers collaboratively focused on 
issues of portfolio implementation as an ongoing process. This in-depth look 
at portfolio use as a process resulted in a complex view of possibilities and 
problems associated with using portfolios to support evaluation purposes in 
classroom settings. Third, the researchers achieved a personal realization that 
when portfolios are viewed as dynamic learning events rather than as static 
entities, they can serve as a catalyst for change (as opposed to merely 
documenting change) that can transform the way teachers and students see 

their classrooms as learning environments. 

The dissemination of these findings beyond their immediate impact on 
the researchers' own work as classroom teachers has begun and will continue. 

Numerous presentations at the local level and three presentations at national 

conferences (National Reading Conference and AERA) have already occurred. 
An article recently published in Portfolio News (see Attachment B) is directly 
related to the research supported by this grant as is .an article now under 
review with The Reading Teach er. A third article is currently being revised 
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for submission to a prominent research journal. In addition, teacher- 
researchers Ron Kieffer and Linda Morrison have continued to investigate 
portfolio process in elementary school classrooms with support from The 
National Reading Research Center. 

The researchers wish to express their gratitude to The Spencer 
Foundation for supporting this study which has had a great impact on their 
lives and their work as educators. 
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f ' Taking It Personally 



Mark A. Faust, Ronald D. Kieffer, 
and Jane Hansen 



Taking It Personally: Teacher- 
Researchers Using Portfolios to 
Support Rather Than to Judge 
Their Work 

The Idea that portfolios may offer an 
alternative to standardized evaluation 
methods has generated considerable 
interest and experimentation in recent 
years. We are encouraged by the fact 
that in school districts and colleges 
nationwide, a steadily growing number 
of students use portfolios in a variety of 
ways to document and enhance their 
learning. The fact that many future 
teachers create portfolios in connection 
with their courses of study (Ford 1994; 
McLaughlin 1994; McMahon 1994; 
Udelhofen 1994) is also an encouraging 
development. But there is a third area 
that is receiving less attention than we 
believe it deserves: the teacher’s own 
portfolio. In addition to researching 
portfolio possibilities in our classes, 
each of us creates our own portfolio to 
help us better understand what we ask 
our students to do. Last year, the three 
of us shared our portfolios with each 
other at the National Reading 
Conference and decided to propose a 
colloquium at the 1994 conference in 
San Diego that would bring together 
other teacher-researchers interested in 
sharing their personal experiences with 
portfolios. The purpose of this article is 
to describe what we are learning as we 
create and share our portfolios. 

Portfolios: A View from the Inside 

We each began with familiar notions 
about portfolios: (1) They are collections 
of work and (2) these collections are 



used for evaluation. We asked our- 
selves questions about the purposes of 
our portfolios and how they might be 
presented to potential audiences. Will I 
use my portfolio to evaluate my teach- 
ing? Will I use It to show how 1 use my 
knowledge as a parent in my teaching? 
What influence will my portfolio have on 
my class when I share it with them? 

The individual contexts created by our 
unique responses to these questions 
guided the process each of us used to 
select specific items drawn from our 
past, present, and future experiences. 
Each of our portfolios also includes 
reflections upon individual items and 
the collection as a whole. In all of the 
ways described so far, our portfolios 
look a lot like those that our students 
produce. 

(continued on page 12} 

student to Student: 
Getting the Most out of 
Your Portfolio 

Jon Foreman 



If it weren’t for portfolios, I’d be very 
depressed right now. 1 would have left 
my senior English class knowing how 
hard I had worked, with nothing to show 
for what I had put into the class. The 
work would have left me ready for 
college but loathing the English language. 
My final portfolio allowed me to admire 
the ground that 1 had covered in the 
course of the year. But more important- 
ly, my portfolio inspired me to reach for 
new heights in the future. Of course, 
looking back to see what I had accom- 
plished made the year much more 
worthwhile, but looking forward towards 
future goals showed my desire to improve. 
This aspiration to grow could not have 
been achieved without a portfolio. 
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However, a portfolio can be an over- 
whelming project. My first portfolio, in 
my sophomore year, was not a very ful- 
filling experience. I was proud of what I 
had accomplished but my portfolio was 
a worthless reiteration of what I had 
done. It had no depth and documented 
only what was necessary. Instead of 
looking forward with high hopes to 
achieve more, I could only wait to forget 
(cor :'nued cn page 6} 



Inside PORTFOLIO NEWS: 



Editorial: Looking Back, 

Looking Ahead 
Portfolio Presentations 
Learning Science through 
Writing: A Cross-Application 
of Skills through Portfolios 
Schoolwide Writing to a Single 
Prompt A Portfolio Activity 
Three-Dimensional Portfolios: 
“Culture Bags” 

First Principles 
Professional Development ‘ 

. . What Can You Learn at 
a Conference? • . 

Vermont Portfolios on Disk? ^ 
Advanced Placement ^ 

Art Portfolio ; - - - 

Connecting Classroom and 
Large-Scale Assessment 
‘ The CLR Moderation Process 



10 

11 



11 

15 

16 



Adding up Learning with 
Math Portfolio . 
Reader Survey - .. 

Review^ the Literature.; ' 
Portfolio Resources'. ; / ' 

Informatlori Exet^nge > / 






19 

20 
20 
21 ' 
22 



PORTFOUO hBitfS b pubiahed by the 
PortfoSo Amesament Clearinghouse, 
a iW)tw6H( of educators Involved In 
portfbio asesesment 



BEST COPY AVAILABLE 





m 



Taking It Personally 



(continued from page 1) 

In other aspects, however, our experi- 
ences with portfolios turned out to be 
much less similar, given the current 
trend toward using portfolios solely as a 
method of evaluation. Over time, the 
three of us have come to viev/ our port- 
folios not as static entities but as 
ongoing events that are still evolving. 

We have found that they take on new 
and interesting meanings every time we 
share them with a different audience. 

We have learned as well that the 
process of composing portfolio reflec- 
tions can be more subtle and complex 
than we anticipated it would be. 

Perhaps the most striking development 
in our thinking about portfolios is evi- 
denced by in our motivation for continu- 
ing to work on them. It is clear to us 
that we use our portfolios to learn about 
ourselves and to support our engage- 
ment with particular questions and con- 
cerns which we care about deeply. We 
simply do not view our portfolios pri- 
marily as providing a basis lor judging 
our writing or our performance as 
teachers or learners. 

After discussing these issues with 
students and colleagues at home and 
more recently at the National Reading 
Conference in San Diego, we have 
learned that others share our emerging 
sense that, because portfolios have the 
potential of serving multiple purposes, 
we as teachers need to be thoughtful 
about how we introduce them to stu- 
dents. The experience of creating port- 
folios of our own has made us aware of 
possibilities that are likely to be eclipsed 
when portfolios are created solely as 
products to be judged rather than as 
sources of reflection and growth. In the 
following section, we will briefly 
describe the portfolios we are creating, 
elaborate on the issues raised above, 
and refer to other voices including some 
of those we heard at our National 
Reading Conference colloquium. 
Accounting for Change 

The portfolio Mark created focuses 
on his experiences as a high school 
English teacher duhng a time when he 
transformed his stance toward teach- 
ing. The purpose of his portfolio js to 
support Mark’s attempt to better under- 
stand the genesis and development of a 
specific period of change in his life. 
Accomplishing this, he hopes, will 
enhance his ability in the future to 
understand and empathize with the 
needs of beginning teachers. Mark has 
revised his beliefs about the relationship 



between theory and practice in teacher 
development by selecting and reflecting 
upon: 

1 . handouts, assignments, and exams 
created at the time; 

2'. samples of student writing; 

3 academic writing he produced then 
as a graduate student; 

4. informal writing he produced in 
response to literary texts; and 

5. items drawn from various journals he 
created during the years in question. 

The following sentences appear in a 
reflection he wrote based on a journal 
entry that was originally composed 
eleven years ago: *Tm just beginning 
pn 1994] to question the adequacy of 
the theory-into-practice metaphor that 
until now has guided my thinking about 
teacher change. Authentic purposes for 
learning, questioning, reading as event, 
reading/writing connections — all had 
become major concerns for me by 
1983, but 1 continue to work on living 
those concerns in response to the 
changing situations of my professional 
life." Where Mark once saw a straight- 
forward process of generating practice 
by reflecting on theory, he now sees a 
more complex and ongoing process of 
generating theory by reflecting on prac- 
tice. Creating a portfolio focusing on 
change has contributed to Mark’s 
recognition that his evolution as a teacher 
has been much more complex and less 
linear than he had remembered it to be. 
Making Life Connections 
During the past two years, Ron’s 
portfolio has changed according to his 
changing portfolio purposes. At first, he 
attempted to understand the processes 



The letter written and shared in a 
writer’s workshop during Ron's middle 
school composition cIlss connects his 
family to his teaching as ne models 
reading/writing processes. Kelley's 
story represents a moment in time 
which alone appears isolated, but in 
combination with other stories begins to 
build an ethnography of Kelley’s life, 
defining her as a learner. The family 
video not only demonstrates important 
principles about family literacy, but also 
• serves as a way of remembering the 
richness of Ron's family experience. 
These tangible pieces of his life story 
create a clear picture of him by con- 
necting the people and events in his life 
to his teaching and research. As Ron 
continues to gather and tell stories 
about his personal and professional 
history, he reaffirms how connected 
everything really is, and hov/ his portfo- 
lio ultimately represents a self-narrative, 
a whole life portfolio. 

Finding a Voice 

Jane started her portfolio in the 
summer of 1989 and has revised it con- 
stantly since that time. It has served 
and continues to serve many purposes. 
The most salient one for this article is 
her evaluation of her evolution as a 
researcher. Her portfolio begins with 
her early years on the farm in Minnesota 
where her family placed value on the 
strength of each person’s ability to 
make decisions, a precursor to her 
research in classrooms where students' 
voices carry as much weight as that of 
the teacher. 

She then shows her early teaching 
career and includes a quote from her 
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Taking It Personally 

(continued from page 12} 

Portfolios: What for? Who for? 

Portfolios are generally touted as 
alternative, authentic methods for 
judging progress and/or performance 
(e.g., Anson 1994; Heiden and Scanlon 
1994; Tierney et al. 1991; Valencia et al. 
1994). Indeed, the three of us have 
used portfolios for this purpose in our 
own classes. In addition, we have 
spoken with colleagues representing a 
full range of academic levels (pre- 
kindergarten through college) who have 
done the same. On one hand, ail this 
experimentation has persuaded us that 
portfolio use does in fact offer a pro- 
ductive alternative for teachers seeking 
to supplement or replace more tradi- 
tional methods of evaluation. On the 
other hand, our personal experience 
with creating portfolios has confirmed a 
suspicion that something important is 
lost when portfolios are used for pur- 
poses of external evaluation and 
grading. Consequently, we want to 
consider further those issues raised 
above, which to us suggest at least the 
possibility of there being, so to speak, 
an alternative to the alternative. 

Since our portfolios were self-initiat- 
ed, we experienced the kind of freedom 
that authors enjoy when they make 
crucial decisions regarding the purpose 
and development of their creative 
endeavors. The significance of this 
sense of authorship is evident in the 
personal commitment each of us feels 
toward our portfolios as ongoing events 
in our lives. Other experienced teach- 
ers we know who author their own port- 
folios have expressed similar feelings 
about discovering ownership of the 
purpose. This insight leads directly to 
the idea that ownership. Is in a sense, the 
driving purpose for making a portfolio. 

One member of our colloquium in San 
Diego. Norma, spoke about constantly 
revising her portfolio which she described 
as representing the diverse and evolving 
literacies that give meaning to her life. A 
portfolio, she said, can be “an ongoing 
you." Portfolios do seem to offer a way 
to revisit and reclaim aspects of our 
lives as we gain an understanding of our 
personal and professional growth (see 
Zebrosky 1994). Our concern is that 
the full potential of this power may be 
compromised in situations where the 
authority to determine the purpose for 
making a portfolio is assumed by 
someone other than those who are 
expected actually to create them. 
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Alongside the crucial question of 
purpose lies an equally important ques- 
tion: Who are the implied readers of a 
portfolio? In the absence of a predeter- 
mined audience (e.g., an external evalu- 
ator of some sort), we have been free to 
immerse ourselves in writing to explore 
what our portfolios might mean to us in 
light of the ongoing purposes they were 
designed to serve. We suspect that 
other “levels" or “layers” of reflection 
(authorship) might be required if we ever 
want to target potential audiences 
beyond ourselves, colleagues, and stu- 
dents, who care about us as individuals. 

Responding to this issue, Jerry, 
another participant in our colloquium, 
talked about a special “synergy” that 
arises when teachers "link autobiogra- 
phy with curriculum inquiry." In his 
view, communities of teachers and 
learners may servt? to expand the 
potential audience for portfolios such as 
ours. Not convinced by this argument, 
Becky observed that a discontinuity will 
inevitably exist between the private 
value of portfolio reflections and the 
pressure towards standardization exerted 
by schools and other public settings. In 
general, the discussion in San Diego 
confirmed our belief that writing portfo- 
lio reflections or evaluations about arti- 
facts Is a more complex and challeng- 
ing process than is commonly recog- 
nized in the literature on portfolios. 

Questions about purpose and audi- 
ence bring into bold relief the distinction 
between using portfolios to support 
learning versus using them to judge 
progress or performance. Where an 
audience consists of one or more exter- 
nal evaluators whose primary concern is 
to judge a portfolio according to preset 
criteria, the potential for an author/ 
reader relationship is nearly, if not com- 
pletely, silenced and with it that aspect 
of the portfolio process which we find 
most engaging. On the other hand, 
readers who are willing to revise their 
expectations in response to an individ- 
ual’s portfolio seem to us a productive 
alternative. 

During our colloquium, Jane 
described her habit of welcoming 
opportunities to share her portfolio, 
which has meant that she constantly 
revises her reflections to include new 
insights gathered from the responses of 
others. In her view, “sharing keeps it 
alive" while "achieving closure” would 
not be a very relevant goal for her port- 
folio. In classroom situations wherein 
this high degree of personal responsibil- 
ity for purpose and audience is limited 
or absent, a portfolio all too easily 
becomes just another assignment 
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I drained of the positive energy that has 
; caused so much optimism about this 
I "alternative" (Roemer 1991). We believe 
I our direct, personal experience with 
portfolios encourages the acceptance 
j of multiple purposes, supports self- 
evaluation, and prompts us to seek 
constructive audiences. 

I Portfolios: An Alternative View 

I We want to emphasize that we are 
i not proposing a particular format for 
! using portfolios. Our primary con- 
j tention is simply that students ought to 
I participate as much as possible in the 
! decision-making process that will affect 
j their role as creators of their own port- 
I folios. We believe there are several 
I questions, beginning with the question 
of who will create a portfolio, that guide 
‘ the evolution of portfolios and that each 
I one ought to be negotiable in particular 
j classroom situations. What motivates a 
I student in a particular class to become 
I the creator of a portfolio? To what 
: extent will students be able to deter- 

mine the purposes of their portfolios? 
j Might other options be made available 
I to those who resist the notion of creat- 
I ing a portfolio? 

j Other questions pertain to the details 
j of the portfolios. What will be included 
i in individual portfolios? How will the 
contents be arranged? What will the 
j physical containers look like? What set 
i of expectations will guide the composi- 
I tion of “reflections"? With whom might 
I individual students expect to share their 
portfolios? Under what conditions 
might this sharing take place? 

If portfolios are going to be used for 
I evaluation purposes, then what exactly 
I are those purposes and how will these 
i be connected with the expressed needs 
I of students? Who will do the evaluating 
I and how will the evaluations be carried 
j out? Our personal experience with 
portfolio processes leads us to con- 
clude that the decisions raised in all of 
the above questions need to be explicit- 
ly addressed and that the responsibility 
for making them ought to reside as 
much as possible in the hands of indi- 
vidual portfolio creators. 

We understand that institutional con- 
straints, especially those that mandate 
a direct connection between evaluation 
and grading, can transform what 
appears to be a sensible enough pro- 
posal in the abstract into a troubling 
process in actual practice. This 
concern notwithstanding, we stand 
behind the idea that portfolio creators 
should enjoy all the rights and responsi- 
bilities that go along with genuine 
authorship. Furthermore, the process 
(continued on page 14) 
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Taking it Personally 

(continued from page 13) 

of creating our own portfolios has 
resulted in products that are ongoing, 
that connect our personal and profes- 
sional lives in highly individual ways, 
and that would not be very useful for 
purposes of judging any aspect of our 
progress or performance as teachers or 
learners. We are not claiming that our 
approach to the portfolio process 
should be universalized as a new stan- 
dard for portfolio use across ail situa- 
tions. Our stance is that among the 
multiple purposes for using portfolios in 
school settings there ought to be some 
opportunity to use them for purposes 
other than judging and grading. 
Teachers and students who design their 
own portfolios for their own purposes 
may discover, as we did, a powerful 
way to connect with and share their 
goals for living and learning. ■ 
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First Principles 

(continued from page 10) 

must be aware of the standards or crite- 
ria according to which they should eval- 
uate their work. In classrooms' in states 
or districts where standards have been 
adopted on a large scale, this means 
familiarizing students with those stan- 
dards. To illustrate this approach, ! 

Hewitt includes in Chapter 8 the analyt- I 
ic assessment guide which he and his i 
teacher committee designed for the I 
Vermont Assessment, and he suggests i 
specific activities for helping students ; 
begin to internalize such standards as | 
they assess and revise their own work. I 

For situations in which such standards j 

are not imposed from outside, he sug- 
gests how teachers might facilitate 
class discussions which lead students 
j to generate their own criteria for good 
! writing. 

For teachers interested in large-scale 1 
assessment, which he defines as “any 
assessment program that involves 
teachers from more than one school,” 
Hewitt poses a set of questions that 
ought to be considered by all partici- 
pants in the design program: 

I 1 . What is the purpose of the assessment? 

I 2. Who is to benefit? | 

I 3. How will the assessment serve that | 

! purpose? j 

I 4. How will results be reported? Will 
1 they serve the purpose? How will the 
beneficiary be served by this report? 

5. What are the stakes? 

6. What will be assessed— a portfolio, or 
something equivalent? Is it valued by 
the student as valid and important? 

7. Do the school and local community | 

equally value the student’s perfor- ' 
mance as valid and important? ! 

I 8. What are the specific standards of 
\ this assessment? Do they match the \ 
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purposes of the assessment and can j 

they be reported in a fashion that 
meets this purpose? | 

9. Is all this manageable? What is a • 

generous, but challenging, timeline? 
in this chapter, he also discusses 
several issues associated with large- 
scale assessment, including the demands 
of performan-je-based assessment, reli- 
ability, and the implications of high 
versus low stakes assessment. 

Chapter Nine, “Portfolios, Goal 
Setting, and Self-Assessment," offers 
examples of students engaged in 
thoughtful reflection on their work and 
provides specific suggestions for how 
such reflection might be supported. An 
inter-school writing assessment 
exchange as well as various approach- 
es to encouraging students’ written self- I 

reflections are featured. j 

The concluding chapters of the book 
deal specifically with the concerns 
associated with using portfolios for 
assessment/accountability purposes. 

They include an analysis of the issue of 
reliability in scoring and of procedures 
for reporting results, as well as a projec- j 

tion into the future, which includes a I 

look at the adversarial relationship i 

between standardized testing compa- | 

nies and advocates of performance i 

assessment. It is possible, he notes, I 

that one way in which those companies 
might attempt to overcome that adver- 
sarial relationship is by getting into the ; 

business of marketing standardized ! 

portfolio assessment procedures • 

designed to eliminate the current relia- 1 

bility problems associated with some ! 

portfolio assessment projects by attempt- 
ing to assess students’ unique portfo- j 

lios against a common set of criteria. j 

In commenting on the Implications of i 

such efforts, Hewitt alludes to the "first | 

principles” about the teaching of writing j 

which he has articulated throughout the j 

book. His experience in designing 
large-scale assessment and his back- 
ground as a writer and teaching of 
writing lead him to conclude that it 
would be “a cruel irony, indeed, if port- 
folios, whose strengths lie in showing 
each student’s unique capabilities, 
became — in the interest of scoring relia- 
bility — little more than long-winded 
standardized tests." ■ 
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A Portfolio Primer: Teaching, Collecting, 
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